Chinese named entity recognition algorithm based on the improved hidden Markov model
نویسنده
چکیده
This paper proposed an algorithm based on the improved Hidden Markov Model (HMM) to achieve the Chinese Named Entity Recognition (NER) in Nature Language Processing (NLP) .It put forward three kinds of familiar recognition methods on the basic of summarizing the trait and difficulty of Chinese NER. The application of the Hidden Markov Model (HMM) based on statistical method in NER was researched. It pointed out and analyzed the limitation of the conventional HMM. At the same time, some improvements have been made in addition.
منابع مشابه
Product Named Entity Recognition Based on Hierarchical Hidden Markov Model
A hierarchical hidden Markov model (HHMM) based approach of product named entity recognition (NER) from Chinese free text is presented in this paper. Characteristics and challenges in product NER is also investigated and analyzed deliberately compared with general NER. Within a unified statistical framework, the approach we proposed is able to make probabilistically reasonable decisions to a gl...
متن کاملA Joint Chinese Named Entity Recognition and Disambiguation System
In this paper we describe an integrated approach for named entity recognition and disambiguation in Chinese. The proposed method relies on named entity recognition (NER), entity linking and document clustering models. Different from other tasks of named entities, both classification and clustering are considered in our models. After segmentation, information extraction and indexing in the prepr...
متن کاملImproving Phoneme Sequence Recognition using Phoneme Duration Information in DNN-HSMM
Improving phoneme recognition has attracted the attention of many researchers due to its applications in various fields of speech processing. Recent research achievements show that using deep neural network (DNN) in speech recognition systems significantly improves the performance of these systems. There are two phases in DNN-based phoneme recognition systems including training and testing. Mos...
متن کاملProduct named entity recognition in Chinese text
There are many expressive and structural differences between product names and general named entities such as person names, location names and organization names. To date, there has been little research on product named entity recognition (NER), which is crucial and valuable for information extraction in the field of market intelligence. This paper focuses on product NER (PRO NER) in Chinese te...
متن کاملMulti-View Hidden Markov Perceptrons
Discriminative learning techniques for sequential data have proven to be more effective than generative models for named entity recognition, information extraction, and other tasks of discrimination. However, semi-supervised learning mechanisms that utilize inexpensive unlabeled sequences in addition to few labeled sequences – such as the Baum-Welch algorithm – are available only for generative...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014